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Abstract. We study the class of cooperative Boolean networks whose only 
regulatory functions are COPY, binary AND, and binary OR. We prove that 
for all sufficiently large N and c < 2 there exist Boolean networks in this class 
that have an attractor of length > whose basin of attraction comprises an 
arbitrarily large fraction of the state space. The existence of such networks 
contrasts with results on various other types of dynamical systems that show 
nongenericity or absence of non-steady state attractors under the assumption 
of coopcrativity. 



1. Introduction 

Understanding the role of feedback is crucial in the study of dynamical systems; 
see, e.g., [23, 24 for relevant surveys. The absence of negative feedback loops tends 
to favor steady state attractors. For example, continuous flows without negative 
feedback loops are known as monotone systems. In these systems trajectories con- 
verge generically towards an equilibrium under mild regularity hypotheses; see e.g. 
[H [121 [20] ■ Similarly, [151 [IS] show that in Boolean networks with asynchronous 
updating negative feedback loops are necessary for the existence of attracting limit 
cycles. 

Here we study a related question for Boolean networks with synchronous updat- 
ing, which is the updating scheme originally proposed by Stuart KaufFman in his 
seminal papers |13[ I14| . More specifically, we study the class of cooperative such 
Boolean networks which is defined by the total absence of negative interactions. 
Cooperative Boolean networks are the ones whose regulatory functions can be rep- 
resented by compositions of AND, OR, and COPY functions, without the use of 
negations. This is a more restrictive notion than the absence of negative feedback 
loops, which are defined as containing an odd number of negative interactions. 

In Boolean networks with synchronous updating negative feedback loops are not 
necessary for the existence of non-steady-state attractors, even exponentially long 
ones. It is shown in [3l [3 [21] that iV-dimensional cooperative Boolean networks 
can have attractors of size up to {^j^^2\) ~ ^ote, however, that this up- 

per bound implies that no attractor in sufficiently high-dimensional cooperative 
Boolean networks can comprise a fixed fraction of the state space, whereas with- 
out the assumption of cooperativity even the whole state space can form a cyclic 
attractor of length 2^. Moreover, in a randomly chosen iV-dimensional coopera- 
tive Boolean network, with probability approaching one as N ^ oo, a steady-state 
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attractor will be reached from a randomly chosen initial condition in at most two 
steps [Tl] . 

This naturally raises the question whether there exist, for given constants p, c 
with 0<p<l<c<2, cooperative Boolean networks of arbitrarily large di- 
mension N for which the union of the basins of attraction of limit cycles of length 
> 2'^ comprises a fraction of at least p of the state space; a property that we call 
p-c-chaos. In this paper we answer this question in the affirmative. The Boolean 
systems that we construct use only regulatory functions with one or two inputs and 
are such that with probability > p the trajectories of any two randomly chosen ini- 
tial conditions will become equal in the long run, a property we call p- coalescence. 
Note that the latter implies that the basin of attraction of a single attractor of 
length > 2'^ comprises a fraction of > p of the state space. 

Before we formally state our theorems in Section [Sj let us make some additional 
comments on their relation to the literature on the subject. 

The dynamics of Boolean networks tends to fall either into the ordered regime 
that is characterized by short attractors, a large proportion of eventually frozen 
nodes, and low sensitivity to perturbations of initial conditions, or into the chaotic 
regime that is characterized by very long attractors, very few eventually frozen 
nodes, and high sensitivity to perturbations of initial conditions |15j . Note that 
p-c-chaos is a direct formalization of the first hallmark of chaos. It also implies, 
for suitable choices of p and c, a small proportion of eventually frozen nodes (see 
Proposition [321) ■ the other hand, p-coalescence implies low sensitivity of long- 
term behavior to perturbations of initial conditions. Thus the dynamics of the 
Boolean networks we construct here are extremely chaotic in one sense and highly 
ordered in another sense. 

There exists a large body of literature on the expected dynamics of so-called 
random Boolean networks (RBNs) with certain restrictions on their connectivity 
and regulatory functions (see, e.g., the surveys [2j [TOj US]). In these studies one 
considers a class B of Boolean networks with a given (usually uniform) probability 
distribution and tries to determine the expected values of the length of attractors, 
the proportion of eventually frozen nodes, or measures of sensitivity to initial con- 
ditions. For example, let Bn,k be the class of Kauffman's NK-networks, that is. 
Boolean networks with N variables and the sole restriction that each regulatory 
function can take at most K inputs. Then the expected dynamics of Bn,k becomes 
more chaotic as K increases from 1 to in terms of all three features described 
above. In particular, p-c-chaos is generic in Bn,n when p < 1 and c < This 
contrasts sharply with the situation for randomly chosen cooperative Boolean net- 
works without any restrictions on the connectivity for which the above mentioned 
results of show that p-c-chaos is about as non-generic as possible. In a similar 
vein, simulation studies 22 indicate that decreasing the amount of negative feed- 
back in RBNs from Bn,k has the effect of decreasing the average lengths of the 
attractors. 

While Boolean networks with fewer inputs per node tend to have on average 
shorter attractors, it is still possible to construct quadratic Boolean networks (that 
is, such that each node takes at most two inputs) with attractors whose length is 
a fixed fraction of the state space of very large dimensions [ini 113 ■ Cooperative 
bi-quadratic Boolean networks (that is, such that the number of in- and outputs 
per node is bounded from above by 2) can still have an attractor of size > c^ for 
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each c < 2 and all sufBciently large [71 IH]- However, if in addition to the latter 
we require that at least a fixed fraction a > of all nodes take exactly two inputs, 
then the length of attractors is bounded from above by for some Ca < 2. In 
particular, ci — 10^/^ and the bound is sharp [71 [S]- The constructions in [71|S] do 
not appear to be adaptable to yielding p-c-chaotic cooperative Boolean networks 
for p + c arbitrarily close to 3, which is achieved by the alternative construction 
described here. The Boolean networks in our construction are also bi-quadratic. 
While the latter property is not actually needed for the construction, it adds interest 
to our results in view of these bounds on attractor length. 

2. Basic definitions 

Let [N] denote the set {1, . . . , N} and let 2^ denote the set of all binary vectors 
with coordinates in [N] . An N -dimensional Boolean system M (or Boolean network) 
is a pair B = (2^, /), where / : 2^ — 2^ is a Boolean function. While / uniquely 
determines B, we will make a careful verbal distinction between a Boolean network, 
which is a pair, a Boolean function / : 2*" — >■ 2", and a partial Boolean function 
/ :C 2'' ^ 2". 

For a Boolean network B = (2^,/), the updating function / determines the 
successor state s{t + 1) of a Boolean state s{t) G 2^ one time step later according 
to the formula 



(1) s{t + l) = f{s{t)). 

Note that / = (/i, . . . , /jv), where the components /i : 2^ — )■ {0, 1} give us the 
successor states for individual variables according to 



(2) s,(t + l) = /,(s(<)). 

We will sometimes refer to fi as the regulatory function for variable i. Since the 
state space 2^ is finite, the trajectory s(0),s(l), ... of an initial state s(0) must 
eventually revisit the same state and thus must either reach a fixed point s{t) {i.e. 
a state with f{s{t)) = s{t)) or a cyclic attractor of length < 2^. 

Now fix a Boolean network B = (2^, /). For s = (si, . . . ,sn) and i € [N] let 
s J* = (s]^, . . . , Sj-i, 1 — Sj, Sj+i, . . . , sn) be the state obtained from s by a one-bit 
flip at position j. If for some s and j we have fi{s) ^ fi{s ^*), then we say that 
variable j is an input of variable i and variable i is an output of variable j . We 
call B quadratic if each variable takes at least one and at most two inputs and 
bi-quadratic if each variable takes one or two inputs and has at most two outputs. 
A partial Boolean function / is cooperative if s < s implies /(s) < /(s "*"), where 
< denotes the coordinatewise partial order of Boolean vectors. By considering its 
conjunctive or disjunctive normal form, it is easy to see that a Boolean function 
is cooperative iff it can be represented as a composition of the functions COPY, 
AND, OR and Boolean constants. Note that B is quadratic and cooperative iff each 
regulatory function is either COPY, binary OR, or binary AND. We specifically 
exclude Boolean constants in this definition since our construction works without 
their help, which leads to a slightly stronger result. 

The following fact will be useful in some of our constructions. 

Proposition 2.1. Let f :C 2'^' 2^ be a partial Boolean function. 
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(a) If the domain of f consists of vectors that are pairwise incomparable in the 
coordinatewise partial order, then f is cooperative. 

(b) If f is cooperative, then f can be extended to a cooperative total Boolean function 
/* : 2"' 2". 

Proof. Point (a) follows immediately from the definition of cooperativity. For the 
proof of (b) we can define the i-th coordinate /*(s)i of f*{s) as the minimum of 
/(s over s + in the domain of / with s < s +. □ 

For 0<p<l<c<2we say that a Boolean system B is c- chaotic if it 
contains an attractor of length > c^, and we say that B is p-c-chaotic if attractors 
of length > c^ will be reached with probability > p, that is, if a proportion of > p 
of all initial states belongs to basins of attraction of attractors of length > . 

A variable Si is eventually frozen along a trajectory if the value Si(t) is fixed 
for all s{t) in the attractor. We say that B is p-fiuid if with probability > p the 
attractor of a randomly chosen initial state has a proportion of less than 1 — p 
eventually frozen variables. 

Two initial states s *'(0),s ^(0) coalesce if there exists a time t > Q such that 
s^{t) — s^it). We call B p-coalescent if any two randomly and independently 
chosen initial conditions will coalesce with probability > p. 

3. Statement of main result 

We will prove the following result that strengthens Theorem l(i) of [7]. 

Theorem 3.1. Given any 0<p<l<c<2, for all sufficiently large N there exist 
p-c-chaotic, p-coalescent, N -dimensional bi-quadratic cooperative Boolean networks. 

Let us briefly address the second hallmark of chaotic dynamics, few eventually 
frozen nodes, that was formalized above as p- fluidity. In [7 , some additional effort 
was required to ensure that the c-chaotic systems constructed there are also p-fluid. 
This is not necessary here, since for sufficiently large c the property of p-c-chaos 
already implies p-fluidity. 

Proposition 3.2. Let < p < 1. Then there exists Cp < 2 such that for every c 
with Cp < c < 2 every p-c-chaotic Boolean system is p-fluid. 

Proof. Let p be as in the assumption. Let Cp = 2^, and let Cp < c < 2. Consider an 
initial condition in the basin of attraction of an orbit of size > c^ . If a proportion 
of at least 1 — p of nodes are eventually frozen along the trajectory of this initial 
condition, then the attractor can have length at most 2'p^ = Cp , which contradicts 
the conditions on c. However, p-c-chaos implies that a proportion of more than p 
initial condition belongs to basins of attractions of periodic orbits of length > c^, 
and thus implies p-fluidity. □ 

4. Some Terminology 

Let us begin by introducing some terminology that will be used throughout the 
proof of Theorem 13.11 The set of positive integers will be denoted by N and log n 
denotes logarithm in base 2. 

We generalize the notion Si{t) to sx{t), where X is a subset of the set of all 
variables. Thus sx{t) G 2^ is the vector with coordinates Si{t) for i £ X. 
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If T is a positive integer, and denotes the r-th iteration of the updating 
function / of a given Boolean system, then 

(3) s{t+T) = rm)- 

In the Boolean systems we are going to construct, we will often have subsets 
X, Y of the variables so that the values of Si {t + t) ior i G Y will depend only on 
sx{t). Thus we will construct Boolean systems that satisfy the following for some 
function g : 2^ 2^ and a fixed r 

(4) SYit + T) = rm) lY^gisxit)). 

We will refer to the property expressed by (jl]) by writing that / computes g on 
input X and writes the output to Y after t steps. 

The function g will sometimes be given a verbal or formal description rather 
than be expressed by a separate symbol. 

If (r(<) : t e N) is a given sequence of Boolean vectors in 2^, then we will say 
that / writes r(t) to Y with probability > q for t > t if for a proportion of > g of 
all initial conditions s(0) G 2^ we have: 

(5) yt>T SY{t) = fim) \ y = r{t). 

5. Outline of the proof of Theorem 13. II 

Equipped with the terminology introduced in the previous section we are now 
ready to outline the proof of Theorem 13.11 More precisely, we will actually prove 
Theorem 13.11 in this section with the exception of a number of technical lemmas, 
some formal definitions, and a brief technical description in Section [5] of how the 
components of our construction fit together. 

Let 0<p<l<c<2beasin the assumptions of Theorem 13.11 

The proof of our theorem boils down to constructing, for sufficiently large N, a 
suitable updating function / for a Boolean systems B = (2-^, /). We need to assure 
that / is cooperative, bi-quadratic, and works as expected, with probability > p, 
for randomly chosen (pairs of) initial conditions. 

The set of Boolean variables [N] will contain pairwise disjoint sets Xi, indexed 
by I S /, where / = {0, 1, . . . , |/| — 1}. With probability > p the following will 
hold for all times t of the form t = to + A;|/|, where to is some fixed time and k is 
a nonnegative integer: With the possible exception of indices i in a small subset 
Q C I, each vector (t) will code an integer Vi{t) € {0, . . . , n— 1} for some suitable 
value of n that depends on A''. Moreover, again with the possible exception oii G Q, 
the function / computes addition of 1 modulo n — i on input Xi and writes the 
output to Xi after |/| steps. Formally, the latter means that for times t as above 

(6) VieI\Q Vi{t+\I\) =Vi{t) + l mod (n-i). 

Let X = {Xi : i E 1} and let V ~ {Vi : i e /} be the functions that decode 
integers Vi from certain vectors sXi ■ We will also let X = IJjgj Xi and Y = [Af]\X. 
A structure M = (B,p, /, Q, n, X, Y, V, to) will be called an M -system if it has the 
properties described above. 
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In the next section we will define a type of structure that we call an M M -system. 
Essentially, an MM-system is an M-system with several additional parameters and 
a number of size restrictions on how N, n, \I\, \Q\, \X\, \Y\ are related to each other. 
A major concern here is that we need to assure that |y| is small relative to |X| and 
that IQI is sufficiently small relative to |/|. One of these additional parameters will 
be c; the other parameters will allow us to control the size restrictions mentioned 
above. We will use notations like A4{M, p,c) for MA/-systems or Af-systems with 
only the immediately relevant parameters shown. The implicit understanding will 
be that the remaining parameters are as specified in Definitions 16.11 and 16.21 of 
Section [6l where we will prove that for MM-systems A4{M,p, c) of sufficiently large 
dimensions the Boolean system B is p-c-chaotic (Lemma 16. 3p . 

Now the proof of Theorem 13.11 boils down to proving Lemma 16.41 of Section [6l 
that is, to constructing an MM-system such that the updating function / is bi- 
quadratic and cooperative and such that with probability > y/p the trajectory of 
a randomly chosen initial state will reach a specified state at time tQ. Thus with 
probability > p the trajectories of two randomly chosen initial states will coalesce 
at some time t < to. 

We will deal with the size restrictions in the definition of a il/M-system by 
showing that all functions that / needs to compute are what we call L- functions. 
We will formally define L-functions in Section [T] at the moment it suffices to say 
that i-functions are Boolean functions that can be implemented by cooperative bi- 
quadratic Boolean input-output systems of relatively low depth without adding too 
many variables. The restriction on the depth means that all necessary computations 
will require, for sufficiently large n, only r <C |/| steps, so that the output can be 
written to the required variables before it will interfere with other computations. 

Let us conceptualize the collection of all XiS as a circular data tape, with / 
simply copying the vector sxij^i{t) to sx^it + 1) for most i's, and also copying 
sxoit) to sx|f|_i(i + !)■ 

For t e N let t* = t mod \I\. We single out some ii, 12 € / with 12 = ii — ti and 
construct / in such a way that / computes -I- 1 modulo n — t* in ri steps on 
input Xi-^ and writes the output of this operation to Xi^ . 

Let us for a moment assume this can be done and show how it implies © for all 
times t > to under suitable assumptions on io and s(io)- Specifically, let us assume 
that to — ii and that all vectors sxi(^o) are coding, with the possible exceptions 
of i G Q. Then / computes ^^^(io) + 1 modulo n — ii on input Xi-^ and writes 
the output of this operation to after ti steps. In the next step we will have 
Vii(to -I- 1) "Vii+iito), and thus / computes Wii+i(io) + 1 modulo n — {ii + 1) on 
input and writes the output of this operation to after ti steps. And so on. 
After |/| time steps, the data tape will have come round circle, and we will have 
Vi{ta + = fi(to) + 1 mod [n — i) for all i ^ I, and ^ follows by induction for 
ah t > to. 

The alert reader will have noticed that the variables in Xi2+iUA"i2+2U- • -UXi-^-i 
are really not needed, since sxi {t + 1) will not be a copy of sxi We keep 

these variables here for the purpose of giving a uniform and more easily readable 
description of our construction. A similar remark applies to the variables A^j+i U 
Arij_|_2 U • • • U where io will be defined shortly. 
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In order to make the idea of / computing Vi-^ + 1 modulo n ~ t* work, we will 
need a counter for tracking t* . The easiest way of implementing the counter is as 
a set of variables R so that sii{t) will be a code for t* — t mod \I\. 

Lemma 5.1. There exists an L-function Fi that computes Vi-^ + 1 modulo n — i 
in Ti steps on input {Xi-^^ , R) and writes its output to Xi^ if given input vectors 
(sXi-^ , sr) such that sxi-^ codes the integer Vi-^ and sr codes the integer i. 

We will need to assure that at time t^ the system will reach a state where SR^t) — 
h{t) for all times t > to and the b{t)'s are specified Boolean vectors that make the 
construction work. This cannot be achieved for all possible initial conditions, only 
with probability arbitrarily close to one. 

In Section [7] we will also define a notion of L-sequences. Essentially, these are 
periodic sequences of Boolean vectors, for which there are cooperative bi-quadratic 
Boolean input-output systems B that return this sequence with probability arbi- 
trarily close to one, for all sufficiently large times. As for L-functions, there are 
restrictions on the depth and number of internal variables in B so that we can in- 
corporate B into an MAf-system. Moreover, we require that the vector of internal 
variables of B will eventually assume a sequence of specified states h*{t), for all 
times t > to, also with probability arbitrarily close to one. 

Lemma 5.2. Any specified sequence {b{t) : t (z N) of values of sr such that 
b{t + |/|) — b{t) for all t Cz N is an L-sequence. 

We also need to assure that the function Fi of Lemma 15.11 receives input vec- 
tors sxi that do code for integers. Unfortunately, with probability close to 1, the 
vectors sXi (0) in the initial state will not be coding any integers. In fact, our 
Lemma 19.11 shows that with probability arbitrarily close to 1 as — > oo , each of 
the vectors sxt (0) will be belong to a set of crude vectors that we will rigorously 
define in Section [H 

All crude vectors are incomparable with all coding vectors in 2^^*. The latter 
property turns out to be actually quite useful for our purposes. It allows us to 
incorporate a Boolean circuit into our definition of / so that it takes as inputs 
(sXiQ , Sr) and writes an identical copy of the input sxi^ to sxi-^ if the input consists 
of a pair of coding vectors, but outputs a fixed coding vector if at least one of the 
input vectors is crude. The circuit takes time steps for its calculations, and we 
let io = ii + T3. Formally: 

Lemma 5.3. There exists an L-function F^ on inputs {Xi^ , R) that writes its output 
to Xi-^ and returns a specified coding vector x* on all inputs with the property that 
sxig or sr is crude and that returns an identical copy of sxi^ on all pairs of input 
vectors that code integers. 

Now let < gi,(72 < 1 be probabilities such that (71 + 92 ~ 1 > \/p, that is, 
such that if events E, F occur with probabilities > qi and > 52 respectively, then 
event EOF occurs with probability > y^. Let A^ be sufficiently large so that with 
probability > qi the Boolean input-output system B2 that returns the sequence of 
&(i)'s for all times t > T2, where T2 ^ |/|, behaves as desired and with probability 
> q2 all initial vectors SXi (0) are crude. We will construct the updating function / 
so that it is cooperative, bi-quadratic, computes the functions ^1,-^3 in the sense 
of Q with inputs and outputs as specified by Lemmas EH] and EH with appropriate 
values of b{t) and, with probability > qi, writes these values b{t) to SR{t) for all 
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times t > T2. The formal proof of Lemma 16.41 in the remainder of this paper 
shows that it is possible to construct such / : 2^ — > 2^ for all sufficiently large 
dimensions N in such a way that |/| exceeds the combined number of time steps of 
all necessary computations. 

With probability > ^yp, this presents us with the following situation after t2 '■— 
max{T2,r3} time steps: The inputs sxi^^sji of Fi are pairs of codes for integers 
as needed for the computation of + 1 modulo n — i, since sr = b{t2) is the 
desired value of the counter and sxi^ is the value of for an input with a crude 
coordinate ^^^(O). The analogous property remains true at subsequent time steps. 
Now let us move the system forward to time ti := ^2+^1. At this time, the vectors 
•sXi2 ' ^^i2-'^ ' • • ■ ' 'SXi2_tj+i will be copies of output of / for values of the input vectors 
on Xi^ , R that with high probability are not pairs of codes for integers. We don't 
have much control over these vectors; it is not at all clear whether they are coding 
or crude. So we cannot automatically assume that they will be turned into coding 
vectors once they will have migrated to position ig. This is were Q comes in: We 
let Q = {z2, 12 — 1, ■ • ■ , ^2 — ^1 + !}• One may consider Q a set of "possibly corrupted 
memory locations." Our formulation of ([6]) allows us to disregard these memory 
locations. We will tag these locations by specifying a fixed crude vector h{t) for all 
those times t such that ^3 takes an input vector sxt^ at time t which is a copy of 
some sxi {ti + tiI/I) with i Cz Q, where m is a nonnegative integer. The crude input 
coordinate at these times t will ensure that F^ writes the specified coding vector 
X* to Xi-^ at the corresponding times t + T3. 

Now consider to = ti + \I\. With probability > ^yp the following holds: All the 
vectors sxi(^o) with i ^ Q will be coding. For all t > to > ti, by Lemma |5.2[ the 
vectors Sij(t) can be required to hold codes b{t) for integers so that the function Fi 
will add 1 mod (n — t*) to Vi-^(t) and write the output to Xi^ at time t + ti, 
where t* = t mod |/|, unless sXi (t) is a copy of some sxi{ti + fTi\I\) with i d Q. 
The function F3 will simply copy sxi^ (t) to sxi-^ {t + T3) unless the associated b{t) 
indicates that sxig{t) originates from some sxi{ti + m\I\) with i £ Q. Thus for 
t = to property ([6]) will hold, and by induction, the same will be true for all times t 
of the form t = to + k\I\ for some nonnegative integer k. Since (71+92 — 1 > P, 
the latter implies that B thus constructed can be part of an MM-system, and it 
follows from Lemma [6.31 that B is p-c-chaotic. 

A slight technical difficulty arises from the need for Fi and F3 to receive the 
signal of a corrupted memory location given by a crude b{t) at different times; we 
will show in Section IH] how to implement the necessary phase shift. 

For the proof of p-coalescence, we will need in addition that with probability > 
y/p at time to all variables in the system will assume values specified by a fixed 
vector s + . The argument for this works for randomly chosen initial states with 
probability > qi + q2 — 1 > y/p and goes as follows. Our set of variables is X U 
Y, where Y comprises the internal variables of the Boolean input-output systems 
Bi, i?3 that implement Fi, F3, and B2 that returns the sequence of 5(t)'s, plus some 
dummy variables. We may choose T2 such that already starting from time t2 < ii, 
with probability > qi the vector of all internal variables of B2 will assume a fixed 
sequence of values h*{t) for all times t > by our definition of an L-sequence. 
With probability > q2, all initial values sXi will be crude; as long as ^3 receives 
an unaltered copy of these as its first input, it will turn it into the specified coding 
vector X* . Similarly, the vectors sx^ (ti) for i £ Q will be copied to inputs of F3 and 
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converted by F3 into the value x* after T3 time steps. All these operations will be 
completed before time to. Thus at time to, all vectors sxi will have values specified 
by the fixed sequence of 6(t)'s and the output of Fx on input vectors (x*,h{t)). 
Moreover, the states of the internal variables of the Boolean circuit Bi at time 
will be determined by the sequence of the inputs between times — ti and to — 1, 
which is fixed. A similar observation holds for the the states of the internal variables 
of the Boolean circuit ^3 at time to. The value of any other variable at time t will 
simply be a copy of the value of some output variable of B2 or of some variable 
in X at time t — T, where t < t^. So we will get coalescence on those variables as 
well, and for a proportion of > i/p of initial states, s{to) will be the same state s + . 

6. MM-SYSTEMS 

Let us begin by formally stating the definitions of an M-system and an MM- 
system that were described somewhat informally in the previous section. 

Definition 6.1. An N -dimensional M-system will be a mathematical object M. = 
{M,p,I,Q,n,X,Y,V,to) such that 

• M is an N -dimensional Boolean system. 

• p is a probability such that < p < 1. 

• / = {0, 1, . . . , |/| — 1} is a set of consecutive nonnegative integers. 

• QCI. 

• n is a positive integer such that log(n) is an integer. 

• X = {Xi : i G 1} is a family of pairwise disjoint subsets of the set [N] of 
Boolean variables ofM. 

. Y=[N]\[jX. 

• V = {Vi : i £ 1} is a family of partial functions such that Vi maps a subset 
of 2^' onto {0, ...,n- 1}. 

• to is a positive integer. 

• If is in the domain ofVi, then Vi{xi) will he denoted by Vi. 

• For a proportion of > p of all initial conditions the following will hold for 
all t of the form t = to + k\I\, where k is a nonnegative integer and to is a 
fixed time, and all i € I\Q: 

is in the domain of Vi and 

(7) Vi{t+\I\)=Vi{t) + lmod{n-i-^l). 

As mentioned in the previous section, an MM-system is an M-system with 
certain additional parameters and size restrictions that will imply p-c-chaos in B. 

Definition 6.2. An N -dimensional MM-system is a mathematical object M. = 

,c, e, i5, /3, v) with the following properties: 

• = {M,p, I ,Q,n, X ,Y,V,to) is an N -dimensional M-system. 

• 7={0,l,...,/31og(n)-l}. 

• c, £, S, /3, v are constants such that 1 < 2 < c; ,8, (1 + e) log(n) are positive 
integers, e,S > 0, P > u > 0, and 

(8) log(c)(l+e + ^) < 1. 

(9) Vie/|Xi| = (l + £)log(n). 
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V 



(10) \Y\<^p5~—yog\n). 

(11) \Q\<y\og{n). 

Assume that M is an A^-dimensional MM-system. By © and the choice of / 
we have 

(12) |X| =/3(l+£)log2(n). 
Moreover, by (IT^ and pUj) we will have 



(13) /3(1 + e) log^(n) <N < /3(1 + e + 5) - log^(n). 

Note also that by our choice of /, equation ([7|) becomes 



(14) Vi{t + /31og(n)) = u,;(t) + 1 'mod{n + 

It will often be more convenient to use ^ written in the form ([14] 



Lemma 6.3. Let p,c be constants such that 0<p<l<c<2. Then for all 
sufficiently large N and every N -dimensional M M -system A4{M,p, c), the Boolean 
system B is p-c-chaotic. 

Proof. Let A4(R,p,c) be an A^-dimensional A/M-system with N (and hence n) 
sufficiently large. 

Let s(0) be a randomly chosen initial condition and let A be the attractor that 
the trajectory of s(0) eventually reaches. With probability > p, condition (|14p will 
hold for all t of the form t — to -\- k\I\ such that s{t) E A. If this is the case, then 
we have s(ii/3 log(n)) ^ s{t2f3log{n)) whenever s(ti/3 log(n)) £ A and ti < t2 are 
such that \t2 - ill < n-^Q^LCM{n,n - 1, . . . ,n - l3log{n) + 1). Thus 

^ LCM{n,n- 1, . . . ,n - l3log{n) + 1) 

^ I I — ^i/log(n) 

It is known that 

LCM(7i(n - 1) ... (71 - A:)) > 

kl 

for any n > G N (sec Theorem 4 of 6 ). By Stirling's formula, 

k„k./oZn l,\k „k. /o^Z, ^fe 



in-kY {n- kYe^V2^ {n - kf e'' 



so, for fc = l3\og{n), we have 
(16) LCMin{n-l)...{n- p\og{n))) > 2/3iog'(«)-2,3iog(n) iog(;3iog(„))^ 
From (|15l) and (IT6l) we get 



(27) > 2('9-'')log^(")-2/51og(n)log(^log(n))^ 
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On the other hand, by (fT3l) we have 

(18) ^ 2(i°g('=)(i+'^+'5)'9-'')iog'("), 

For fixed I3,v, the term 2/31og(n) log(/3 log(n)) becomes neghgible as long as n 
is sufficiently large. Thus, by ([8)) the right-hand side of (|17p will exceed the the 
right-hand side of (fT8|) . and Lemma [6.31 follows . □ 

The following lemma implies Theorem 13.11 In view of Lemma 16.31 its first part 
implies p-c-chaos, and its last sentence implies p-coalescence. 

Lemma 6.4. Let p, c be constants such that 0<p<l<c<2. Then there exists 
a positive integer Np,c such that for all N > Np^c there exists an N -dimensional 
M M -system A4{M,p,c, to) such thatM is bi-quadratic and cooperative. Moreover, 
this system can be constructed in such a way that there exists a state s + so that for 
a randomly chosen initial condition s(0) we will have s(io) = with probability 

> Vp- 

7. Boolean input-output systems 

A Boolean input-output system is a hierarchical arrangement of binary variables, 
with the input variables constituting the lowest level, the output variables the high- 
est level and each variable (except for the ones at the input level) taking input from 
one or several variables at some level(s) other than the output level and updating 
their current state according to an AND, OR, NOT gate, or simply copying its 
single input. 

A Boolean circuit is a Boolean input-output system in which all the variables 
(except for the ones at the input level) take input from one or several variables at 
the next lower level. 

The depth d{B) of a Boolean input-output system B is the number of its levels, 
not counting the lowest (input) level. An internal variable of a Boolean input- 
output system is a variable that is neither an input variable nor an output variable. 
We will use the notation B{D^ H, R) to indicate the sets of variables of a Boolean 
input-output system B. In this notation, the sets D,H,R are pairwise disjoint, 
the domain D contains the input variables, the range R denotes the set of output 
variables, and H (for hidden) denotes the set of internal variables. Notice that the 
depth of B{D, H, i?) is 1 iff = 0. 

We will call a Boolean input-output system B = B{D,H,R) cooperative if it 
does not use NOT gates and quadratic if it uses only binary or unary gates. A 
quadratic system is bi-quadratic if each variable in D U H serves as input for at 
most two variables in the system. We say that B is monic if every gate takes 
only one input. Note that this definition allows B to be simultaneously monic and 
bi-quadratic. 

Let B{D,H,R) be a Boolean circuit of depth d and let g :C 2^ — > 2^ be a 
(partial) Boolean function. We say that B calculates g (in d steps) if for every 
input s in the domain of g after d updating steps the value of the output vector 
of B will be g{s). 

Example 1. Let D,R be such that \D\ = \R\ and let x '■ D R be a bijection. 
Define id : 2^ 2^ as the function that extends x to binary vectors in the obvious 
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way. Then there exists a cooperative bi-quadratic Boolean circuit Bid — Bid{D, 0, R) 
of depth 1 that calculates the function id. 

We can construct Bid in such a way that for i Cz D the value of Si (t) will simply be 
copied to s^(i)(t + 1) by a monic regulatory function. This makes Bid cooperative, 
bi-quadratic, and monic. 

Note that since in a Boolean circuit variables at each level take input only from 
the variables at the next lower level, the output of a Boolean circuit of depth d 
(after d steps) will not be influenced by the initial state of its internal variables. In 
contrast, the output of a Boolean input-output system after d time steps may also 
depend on the initial states of its internal variables. 

Let B{D, H, R) be a Boolean input-output system of depth d and let (sfl(t) : 
t e N) be a sequence of Boolean vectors in 2^. We say that B returns sii{t) with 
probability > q for all t > d{B) if for a proportion of > g of all initial states of 
the internal variables of B the output sequence will be as specified for all times 
t > d{B), for any sequence {soit) ■ t G N) of values of the input variables. This 
makes the input variables redundant, but for some constructions in the follow-up 
paper |9l we will need to include nonempty sets D of input variables. For this 
reason we give the definition here in its full generality rather than restricting it to 
the case D = 0, which is the only one needed here. 

Boolean circuits Bi{Di, Hi,Ri) and B2{D2, H2, R2) can be concatenated in the 
obvious way as long as R2 = Di. The concatenation B — Bi o B2 will have input 
variables D2, output variables Ri, internal variables H = H2 U R2 U Hi, and its 
depth will satisfy d{B) = d{Bi) + d{B2). Moreover, if Bi,B2 are Boolean circuits 
that calculate gi, g2 respectively, then B will calculate gi 0(72. One can also convert 
Boolean input-output systems into parts of an updating function / of a Boolean 
network by re-interpreting the logical gates as updating functions for the relevant 
variables. The computations performed by the Boolean input-output systems then 
guarantee the corresponding computations of the updating function / in the sense 
of®. 

Now we are ready to define L- functions and L-sequences. Since we are inter- 
ested in constructing Boolean systems of all sufficiently large dimensions, strictly 
speaking, these objects are really families of functions or sequences that contain 
one representative for each desired dimension N. In order to keep the terminology 
in our already rather technical proof reasonably manageable, we suppress reference 
to the whole family whenever this seems to make our arguments more transparent. 
The size of the domains and ranges of individual L-functions (L-sequences) will be 
controlled by the parameter n in the definition of an MM-system. In Section |9] we 
will define a set M of suitable n, which is, a set of all n S N that could appear as 
parameter in at least one MM-system of interest. Our families of L-functions and 
L-sequences will be indexed by this set. 

Definition 7.1. Let T = (F" : n e M) be a family of functions with F" : 
D{n) — > R{n). We say that JF consists of L-functions if there exist 7 > such 
that for every n G M there exists a cooperative bi-quadratic Boolean circuit with 
< 'y{log(n))^ variables of depth < 7log(n) that calculates F". 

Definition 7.2. Let S — {S(n) : n G M) be a family of sequences with S(n) = 
(s^(i) : i e N). We say thatS consists of L-sequences if for every given probability 
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q < 1 there exists 7 > such that for every ri G M there exists a cooperative bi- 
quadratic Boolean input-output system B = B[%,H,R) with < 'y{log{n))'^ variables 
of depth d < 7log(n) that returns s^(t) with probability > q for all t > d{B), and 
a fixed sequence of vectors h*{t) € 2^ such that with probability > q the equality 
SH{t) = h*{t) will hold for all t > 2d{B). 

Note that certain size restrictions on D{n) and R{n) will be necessary to prove 
that a given sequence is an L-function. Similarly, certain size restrictions on s^(t) 
and the periods T„ will be needed to prove that a given S that consists of se- 
quences s'^(t) with periods T„ is an L-sequence. These size restrictions have not 
been spelled out explicitly in Section [S] they will be made explicit in Section [51 and 
will also be spelled out in Section [TUl where we prove Lemmas l5.1[l5.2[ and l5.3l Let 
us just mention here that for a periodic sequence to be an L-sequence it is actually 
sufHcient that |s^|T„ grows sufficiently slowly relative to n. 

8. Coding vectors and crude vectors 

For an even positive integer k let Ck be the set of all Boolean vectors from 2*^ such 
that exactly half of their coordinates are I's (so the other half are O's). Then {CkY 
is a set of pairwise incomparable vectors for every positive integer £. For every i € I 
we will choose sets C 2^' of coding vectors with C {Ck Y fo'" some suitable £. 
Of course, the sets of variables Xi are pairwise disjoint, so we cannot literally 
make each a subset of {CkY; formally we will need disjoint copies of {CkY- 
However, adding an extra parameter (as in: {Ck{i)Y) appears to introduce only 
clutter and we will use the slightly informal notation for the sake of transparency. 
Similarly, we will require that if bi € 2^^ codes for an integer, then bi G {Ck)™ 
for some suitable m. This assures that all our codes for integers will be pairwise 
incomparable and allows us to construct cooperative Boolean functions since every 
partial Boolean function that is defined on a set of pairwise incomparable Boolean 
vectors can be extended to a cooperative Boolean function (sec Proposition 12. ip . 

On the other hand, we need to be able to define values Vi G {0, . . . , n — 1} for 
Xi G Ci so that we can achieve ([7]). Thus we want Ci to be sufficiently large so 
that there exists a bijection Vi : Ci — >■ {0, . . . , n — 1}. We will show next that this is 
always possible if we judiciously choose k and the parameter e of our MM-systcm. 
The vectors Xi in the sets will henceforth be called coding vectors. 

Definition 8.1. Let c be a constant with 1 < c < 2 and let e > 0. We say that the 
pair (fc, s) is c-friendly if 

k 

(19) £ is rational and — is an integer, 

(20) log(c)(l -l-e) < 1, and 

(21) \Ck\>2''/'^^+'\ 

Lemma 8.2. Suppose 1 < c < 2. Then there exist a rational e = e{c) > and a 
positive even integer k = k{c) such that the pair {k,e) is c-friendly. 
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Proof. Fix any rational e(c) > such that log(c)(l + e{c)) < 1. Note that \Ck\ — 
ik/2) ^ X- Thus for sufficiently large even k we wih have \Ck\ > 2*^/(1+^). □ 

9. The proof of Lemma 16.41 

Having defined all its ingredients, let us formally describe the construction of 
MM-systems for the proof of Lemma [6.41 Given < p < 1 < c < 2, pick e and k 
such that the pair {k,e) is c- friendly. An integer n will be called suitable if there 
exists an integer i such that 



(22) (1 + e) log(n) = ki 

The set M in Definitions 17.11 and 17.21 will be the set of all suitable n. 

Pick 6 with < So < S < 1 such that ^ holds. The latter is possible by pl| . 
We will apply Lemma 15.21 to a periodic sequence with period T of vectors sr £ 2^ 
such that for all sufficiently large N: 



(23) |i?|r<<5olog(n). 

Let 71, 73 > be constants that witness that the functions Fi, F3 of Lcmmas l5.ll 
and 15.31 are L-functions, and let 72 be a constant that witnesses that the sequence 
of values of the counter is an L-sequence whenever the size restriction (1231) holds. 
Let 7 = 71 + 72 + 73 + 1, and let = 71 + 72 + 273. 

Choose a sufficiently large positive integer /? such that 

(24) ^^(^^"^k^)- 

For sufficiently large N, choose a suitable n such that 



(25) /3(1 + e + So) log^in) <N< \^(3{1 + s + 5) ~ — j log^{n). 

This determines the set I = {0, 1, . . . , /31og(n) — 1} and allows us to choose sets 
of variables Xi for ? e / with X = \J-^j Xi such that © and ([H]) hold. 

For each i € / we will identify a set of pairwise incomparable coding vectors 
of 2^^ that correspond to a subset of a copy of {CkY and a bijection Vi : Ci ^ 
{0, . . . ,n — 1} that computes the values Vi{xi) that are coded by Xi G C^. The 
existence of and Vi follows from (PT|) and the choice of n, I. Now we can choose 
m as the smallest integer with KCfc)™] > |/| and choose a set C C (Cfc)™ of codes hi 
for the integers i G I. Finally, we let i? be a set of size km; we will treat bi as an 
element of 2^. It follows from our choice of m that for some constant we have 



(26) |i?| <7i?,log(log(n)). 

The period of the counter will be T = |/| = /31og(n). Thus T and \R\ depend 
on /3, but regardless of the choice of /? the estimate will hold for sufficiently 
large N. 

Let us fix i and write Xi U i? as a disjoint union of consecutive intervals Zf of 
length k each, where j < £ + m and let zj denote the respective truncations of 
Zi E 2^''-'^' to these intervals. Let us say that Zi is crude if there exist j, J < i + m 
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such that zj = and 2/ = 1 . Similarly Xi £ 2"^' is crude if we can find j,J<£ 
with this property. Note that all crude vectors are incomparable with all coding 
vectors. 

Consider a randomly chosen initial state, and let E be the event that all Xi{0) 
are crude. 

Lemma 9.1. Let k,£,l3 be fixed. Then P{E) 1 as n 00. 

Proof. For each i, the probability that x,;(0) is not crude is < 2(1 — 2"^^)^. Thus the 
probability of the complement of i? is < 2/31og(n)(l — 2^''Y. Since log(n) — 
and k,e,P are fixed, the result follows. □ 

Let (71, q2 be probabilities such that if events E, F occur with probabilities > qi 
and > q2 respectively, then event EnF occurs with probability > ^/p. In particular, 
we will assume that N is sufficiently large so that P{E) > qi. 

Let iQ = |/| — 1 and choose two disjoint sets of variables R,Rc with \R\ = \Rc\ 
as in (f26|l . Choose a Boolean circuit B3 = B3{Xig UR, H^, Xi^ ) that witnesses that 
the function of Lemma l5.3l is an L-function, where ii = io — (i(i?3). Then choose 
a Boolean circuit Bi = Bi{Xi^ U Rc, Hi, Xi^) that witnesses that the function Fi 
of Lemma 15.11 is an i-function, where i2 — ii — d{Bi). By Definition 17.11 our 
choice of the input sets of the Boolean input-output systems implies in view of (f26|) 
that we will have ti = d{Bi) < 7i(log(n) + 7^ log(log(n))) and T3 = d(i?3) < 
73(log(n) -|-7_R log(log(n))). For sufficiently large n the terms log(log(n)) become 
negligible, and our choices of v, f3 and / imply that 12 > 0. 

Choose a Boolean input-output system B2 = B2{9, H2, R) that witnesses that 
the sequence b{t) € 2^ of desired values of the counter is an L-sequence for the 
function that returns b{t) S 2^ as needed for the argument presented in Section [S] 
Make sure that the sets Hi, H2, H3, R, Rc, X are pairwise disjoint. These choices 
determine the regulatory functions for all variables in BiU B2U B^, except for the 
variables in Xi^, U Rc. 

For all i € I\{ii,i2} define the regulatory functions for the variables in Xi so 
that they implement the circuit Bid(^i+i, 0, Xi) of Examplc[Tl where |/| — 1 + 1 is 
treated as zero. 

Notice that for the proper working of B3 it only matters whether the value sr at 
a given time t is coding or crude, where the latter property signals that the input 
variables in Xi^ originate from a possibly corrupted memory location Xi with i € Q. 
As already mentioned in Section [5l the circuit Bi needs to receive the same signal 
T3 = d{B^) time steps later. This is where Rc comes in: We make Rc the set of 
output variables of a Boolean circuit B/i = B4{R, H4, Rc) of depth T3 that is the 
concatenation of copies of Bid and simply copies the values of the input variables 
in R to the output variables in Rc in T3 steps. 

This describes the part of our construction that is needed for p-c-chaos in the 
resulting system B. Let T2 = d{B2). Note that as long as N is chosen sufficiently 
large, we can assume that with probability > q2 for all times t > T2 the values SR{t) 
will be the required 6(i)'s. Thus with probability > q2, at all times t > T2 + T3 the 
circuit Bi will receive the required input values b{t) on its input variables in Rc. 
Moreover, at all times t > T3 the inputs of Bi will be coding vectors. Thus 
with probability > ^/p the circuit Bi will write the desired output to Xi^ for all 
times t > Ti + T2 + T3. It follows that the set Q of possibly corrupted memory 
locations has cardinality < ti + T2 + t^. Since Ti < 7^ log(n) by the definitions 
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of L- functions and L-sequences, our choice of v implies (fTTj). and the choice of /3 
imphes that the block of corrupted memory locations does not extend all around 
the "data tape," that is, implies ^ Q. Now the argument presented at the end of 
Section [5] shows that condition ([7]) will hold with probability > ^ > p and that 
we get p-coalescence on the variables for which have already defined regulatory 
functions. 

The part of the system we have constructed so far consists of variables in the 
sets X = Ujgj Xi and := i?c U i? U i/i U i/2 U i/a U H/^ and regulatory functions 
for them. Also, since all Boolean input-output systems that we have used so far 
are cooperative and bi-quadratic, the part of the system that we have constructed 
so far inherits these properties. 

By Definitions 17.11 and 17.21 and our choice of 7 we have 

(27) |r-|<7iog'H 

as long as n is sufficiently large so that 77? log(log(n)) < log(n). We may need to 
add to Y~ a set of dummy variables so that the resulting set Y satisfies |X| + |F| — 
N. By (gl]) and the resulting Y wih satisfy (HU]). We simply define the 

regulatory function for each dummy variable to be the function that copies a value 
from X\{Xig U X^J. This retains cooperativity of the whole system. Since so 
far each variable in X serves as input to at most one other variable and since 
|F| < \X\ — 21og(ri), we have enough different input variables at our disposal to 
assure that the resulting IB will be bi-quadratic. 

The resulting structure satisfies all conditions of an MM-system, which proves 
Lemma 16.41 

10. The proofs of Lemmas 15.11 15.21 and 15.31 
10.1. Preliminary results. 

Proposition 10.1. Let A : {0, 1} 2^ be the function that produces \Y\ identical 
copies of a variable, defined by (A(a;))j, — x for y Cz Y. Then there exists a 

bi-quadratic cooperative Boolean circuit with < 2\Y\ internal variables that 

calculates A in < log(|y|) steps. 

Proof. We consider only bi-quadratic systems, so at one step the content of a vari- 
able can be copied to two variables only. It means that we need |y|-|-|F|/2-f...-|-l < 
2\Y\ variables and < log(|F|) steps. □ 

Proposition 10.2. The functions A : 2^ ^ {0, 1} and \/ : 2^ ^ {0, 1}, defined by 

A{x) = A(xi, . . . ,Xn) ^ Xi A . . . AXn, 
V{x) = V(xi, . . . , Xn) = a;i V . . . V x„, 

for X — [x\^...,Xn) G 2^, can be calculated by bi-quadratic cooperative Boolean 
circuits with < 2 \X\ variables in < [log(|X|)] steps. 

Proof. Group variables into pairs and use a cooperative bi-quadratic Boolean circuit 
of depth 1 to calculate xi A a;2,a;3 A X4, . . . ,Xn~i A x„. If n is odd, use Xn A 
Xn for the last pair instead. Then use induction and concatenation of Boolean 
circuits. The total number of internal variables can be estimated as in the proof of 
Proposition [TUH □ 



COOPERATIVE BOOLEAN SYSTEMS 



17 



Corollary 10.3. For every positive integer r there exist positive integers u{r) and 
d{r) such that every cooperative Boolean function / : 2^ — > 2^ can he calculated by 
a cooperative bi- quadratic Boolean circuit with at most u{r) internal variables that 
calculates f in d{r) steps. 

Proof. Note that the Conjunctive or the Disjunctive Normal Form of cooperative 
Boolean functions do not use negations and use Propositions 110.11 and 110.21 □ 

10.2. The proof of Lemma 15. li Assume the pair (fc,£) is c-friendly and (1 + 
e) log(n) = U. Let be a function that takes as input a pair of vectors {sx^ sn) 
with \X\ = log(n) and \R\ < 7_r log(log(n)) for a fixed constant jr such that F" 
returns the code for V{sx) + 1 modulo n — i whenever sx is coding and sr is 
the code for i. We need to construct a cooperative bi-quadratic Boolean circuit 
B = B{X U R,H,Z) of depth < 7log(n) with \H\ < 7(log(n))2 for some fixed 7 
that calculates F". 

Since all codes are pairwise incomparable, by Proposition 12.11 we may assume 
that F" is cooperative, and hence can be calculated by a cooperative bi-quadratic 
Boolean circuit. Unfortunately, we cannot use Lemma 110.31 directly, since it does 
not give us sufficient control on how fast the depth and number of internal variables 
of this circuit grow with n. Our strategy in this proof will be to break down the 
codes of the integers involved into small chunks of fixed size, use Lemma 110.31 
to build Boolean circuits of fixed size and depth that calculate certain auxiliary 
functions 31,32,53,54 on these chunks, and to use Propositions 110. ll and 110.21 to 
calculate auxiliary functions /ii, /12 that keep track of the global picture and allow 
us to concatenate the smaller Boolean circuits into a larger one with the desired 
properties. 

Let Z? C Cfc be such that \D\ = K = 2tt? and let w : D {0, . . . , - 1} be a 
bijection. In this proof it will be convenient to use the notation x for the input vector 
sx and the notation r for the input vector sr^ of our Boolean circuit. Then x € 2^^ 
and wlog we may assume that r G 2*^™ for some m < £. A vector x (r) is coding 
ii X G {r £ D™). We partition a:, r into consecutive vectors 

x3 g 2^' , r^ e 2^' 

of length k each (as in Section [5]) . The corresponding decoding function V for x is 
then defined by 



Consider four functions with the following properties: 

• (71 : Cfc — 2^ returns (1, 0) for the input x^ e D with w{x^) ~ K — 1 and 
returns (0,1) on all other inputs in D. 

• 32 : C'fe X 2^ -J> Cfe is such that g2{x^ ,1,0), g2{x^ ,0, 1) E D with ^(32(2^^ , 1, 0)) = 
w{x^) + 1 and w{g2{x^ ,0, 1)) = x^ whenever x^ € D. 

• g?, '■ Ck 'X Ck 2^ is such that g^{x^ ,x^) = (1,0) whenever x^ & D, and 
33 (x-' , y-' ) = (0, 1) whenever x^ , Cz D with x^ ^ U'' ■ 

• 34 : CfcX2^ — J- Ck is such that 34(2;-' , 1, 0), 34(2;-' , 0, 1) e D with w{g4{x^ , 1, 0)) = 
and w{g4{x^ , 0, 1)) — w{x^) whenever x^ £ D. 

Since the requirements we have specified for these functions only pertain to 
subsets D,D X {(0, 1), (1, 0)}, or D x D oi the domains that consist of pairwise 
incomparable vectors, we may assume that these functions are cooperative. Thus 



(28) 
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they can be calculated by cooperative, bi-quadratic Boolean circuits Bi, B2, B4 
whose sizes and depths are constant in the sense that they do not depend on n. 

Let hi : (2^)^ — >■ (2^)^ be a cooperative function such that the j-th coordinate 
of its output is (1,0) whenever the i-th coordinates of its input vector are (1,0) for 
all i < J, and is (1, 0) whenever at least one of the i-th coordinates of its input vector 
is (0, 1) for some i < j. By Proposition ll0.2l such hi can be calculated by a cooper- 
ative, bi-quadratic Boolean circuit B^ with < 4 \£\ variables in < [log(|^|)] steps. If 
we compose a product of £ copies of the functions gi on individual components 
of X with hi, we obtain a vector in (2^)^ that indicates the location of carry-over 
digits in the operation w{x) -I- 1 as performed on the codes, with (1,0) indicating 
that w{x^) + 1 needs to be calculated, whereas (0, 1) signals that x^ needs to be 
copied. This composition can be calculated by a bi-quadratic cooperative Boolean 
circuit Be with < 71 \£\ variables and depth < 71 [log(|^|)] , where the constant 71 
depends on the size and depth of Bi . 

If we first duplicate the value of x, keep copying it until Be finishes its cal- 
culations, and then use the copies of x^ as the first inputs in copies of B2, with 
the coordinates of the output of Be providing the second inputs, we can construct 
a cooperative bi-quadratic Boolean circuit Ba with < 72 \£\ variables and depth 

< 72[log(|^|)] that calculates the code for w{x) + 1 mod n for every coding vec- 
tor X. Here 72 is another constant that depends on 71 and the size and depth 
of B2. 

It remains to compare the output of Ba with n— i, where i is coded by r and reset 
it to zero if in fact the two vectors are equal. So far, we have not specified how i is 
coded by the elements of the counter; it will be most convenient if we assume that r 
codes the last mk binary digits of n — i according to ([25)1 . Since m <C ^, we have a 
code for i in this sense iff for the partition of the output of Ba into consecutive y^s 
we have = for all j < m and w(jj^) = K — 1 for j > m. We can use a product 
of m functions of the form 173 with £ — m functions of the form gi to code the 
equality as a vector in (2^)^ all of whose coordinates are (1,0), while inequality will 
be signified by at least one coordinate of the form (0, 1). Composing this product 
with a cooperative function /i2 : (2^)^ — >■ 2^ that returns (1,0) on the code for 
equality and (0, 1) on all codes for inequality results in a function that detects a 
code for n — i. Again, by Proposition 110.21 this composition can be calculated by 
a cooperative, bi-quadratic Boolean circuit Be with < 73 \£\ variables and depth 

< 73[log(|^|)] , where the constant 73 depends on the size and depth of B3. 

To put it all together, we need to copy the value of r until it will be needed for 
the calculation of Be, and also retain a copy y of the output of Ba until Be has 
finished its calculations. Finally, we can use the coordinates of that copy of y and of 
the output of Be as inputs to £ copies of the Boolean circuit B4 that calculates 174. 
This adds < 74 \£\ variables and < 74[log(|^|)] steps to the final Boolean circuit B. 
Since log(rt) < £, we conclude that B will have depth < 7log(n) and < 7(log(7i))^ 
variables for some fixed 7. 

It is straightforward to verify that B is cooperative, bi-quadratic, and calcu- 
lates Fi as required. □ 

10.3. The proof of Lemma 15.21 Lemma 15.21 follows from Lemma 110.41 below 
by letting R be the set of variables for our counter and T = \I\, with g coding 
the sequence of desired values of the counter. By ([26]) and the choice of / we have 
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\R\T < {log{n))" for all a > 1 and sufRciently large n, and therefore Be satisfies the 
restrictions on its depth and number of variables that are implied by Lemma 15.21 

Lemma 10.4. Let < q < I. Then there exists a positive constant 7 such that for 
every nonempty set R and positive integer T and every function g : {0, . . . , T— 1} — >■ 
2^ there exists a Boolean input-output system Be — Bc{9, H, R) with the following 
properties: 

(i) \H\<^\R\T\og{\R\T); 

(ii) d:^d{Be)<^\og{\R\T); 

(Hi) Be is cooperative and bi-quadratic; 

(iv) There exists a fixed state s*^ e 2^ such that for a proportion of > q of all 
possible initial states of the variables in H the following two conditions hold: 

(v) SH{2d+l)^ s*h; 

(vi) For all times t > d the system writes the value g{t mod T) to its output 
variables R. 

Proof. Let q, R, T, g be as in the assumption. Note that we may wlog assume that 
\R\T is sufficiently large, since we can replace T with T+ = kT, choose g{t) — 
g{t — T) for t >T, and make 7 sufficiently large to cover the finite set of instances 
whose original size \R\T was too small for our probability estimates. 

In order to make the idea of our construction more transparent, let us begin by 
specifying the dynamics on the highest level H{d— 1) and the output variables. The 
set H{d—1) will be partitioned into pairwise disjoint subsets Hj for j = 0, . . . , T—1, 
each of size \R\. For any t > d — 1, let t* = t — d + 1 mod T. 

Let us enumerate Hj — {hij : i e [|-R|]} for j e {0, ...,T— 1} and let us 
provisionally define 

(29) /i,j(i+l) = /i,j_i(t), 

where we interpret j — 1 = — lasT— 1. This definition will give us the correct 
output sequence in the sense of (vi) as long as SHj [d—l) = g{t) for all i £ {0, ... , T— 
1}. In other words, we need to make sure that, with sufficiently high probability, 
each of the variables Shi ^ assumes a certain value h* j at time d — 1 , and that at all 
subsequent times the dynamics of H(d — 1) is identical to the dynamics specified 
by ((29| . If we can achieve this, then we can arrange for the output vector s_R(t+ 1) 
to simply be a copy of HT~i{t). 

The following trick allows us to achieve this goal. Let 

Po = {K, e Hid - 1) : hl^ = 0}, Pi = {h,,, e Hid - 1) : K^^ = 1}. 

We will construct B^ in such a way that there exist variables /c^j- G Hid — 2), 
where Hid — 2) is the level right below Hid — 1), i G j < T such that with 
probability > q: 



e Po Sfe.,, (d - 2) & Vt > d - 2 Sk,,^ it) = 1, 
V/iij e Pi Sfe.,, (d - 2) = 1 & Vt > d - 2 Sfe,_^ it) = 0. 



20 



WINFRIED JUST AND MACIEJ MALICKI 



Now we modify (f29| as follows: 

If hij e Po, then Sh,,^ [t + I) = Sh^_, ^ (t) V Sfc^_^. (<), 

If h,^j e Pi, then Sh,_^ (i + 1) = (t) A s^^,^. (t). 

Notice that in view of (pO| . our revised definition ([3T|) of ([29l) ensures that with 
probability > g, at time d — 1 all variables hij will take their desired values, and 
the input from level H{d — 2) will not influence the dynamics at level H{d — 1) at 
any time t > d — 1. 

Therefore, given g < 1, a set P of sufficiently large size, and a partition Pq U Pi 
of P, it suffices to construct a system Bc{9, H, P) of depth d, and s|f S 2^ such 
that for some fixed 7 > that does not depend on \P\, with probability > q: 

(a) |ff|<7|P|log(|P|); 

(b) d<7log(|P|); 

(c) for po g Pq we have Sp(,(ci) = and Spg{t) = 1 for aU i > d + 1; 

(d) for pi g Pi we have Sp^ (d) = 1 and Sp^ (t) = for alH > d + 1; 

(e) SHi2d+l) = s*H, 

where points (c), (d), (e) will hold with probability > q. 

We show how to construct such Bc{^, H, P), provided that Pq is empty. If this 
is not the case, we can construct a dual system to take care of the case Pi = in 
an analogous way and take the disjoint union of the two systems. 

Let Hi be the lowest level of H, let Hh be the highest level, and let Hr denote 
all the remaining levels. Wlog we assume that |P|/16 is an integer, and that Hi 
and Hh consist oi K = A\P\ variables. Let 

P = {pii):i<K/4}, Hi^{hi{i):i<K}, H^ ^ {h^ii) : i < K}. 
Now let 

(32) {h*il),...,h*{K)} 

be an enumeration of the variables hh{l), hh{2) . . . , hh{K/2) such that each variable 
in this set gets listed exactly twice. Similarly, let 

(33) {h** {!),..., h**{K/i)} 

be an enumeration of the variables hfi{9K/16 + 1), . . . , hfi{llK/16), such that 
each variable in this set gets listed exactly twice. The regulatory functions for the 
lowest level Hi are given by 

(34) s,,,(,)(i + 1) = s,i,(,)(t) A Sh*(.,){t), i < K 
and for the output variables by 

(35) sp,(t + 1) = sp^{t) A Sft..(,)(0, i < K/A. 

Now let Hr be an implementation of the sorting function fs'.Hi^ Hh, that is, 
a function such that the number of zeros in x is the same as in f{x) but all the 
zeros in f{x) precede all the ones in f{x). By a result in [1], there exists a sorting 
network of depth 0{\og{K)) that will implement fs- A sorting network performs at 
each step a certain number of pairwise comparisons on disjoint sets of two variables 
and switches the variables if they are in the wrong order. In the Boolean context. 
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this operation can be implemented as sw^Si, sj) = [si A sj, Si V Sj]; a variable that 
does not participate in any comparison at a given step will simply be copied. Thus 
the function can be calculated by a cooperative bi-quadratic Boolean circuit of 
depth 0{\og{K)) with 0{K \og{K)) variables, so the system Bc{9, H, P) satisfies 
(a) and (b). 

Let us make a few observations about the construction that we have described. 
First, note that we will end up with a Boolean input-output system rather than 
a Boolean circuit since there is feedback from levels Hh and Hi itself to level Hi . 
This will be the only feedback loops, the variables at all other levels of H will take 
input only from the next lower level. 

Now define for all times t > 0: 

(36) S{t)=K~J2'hd^)it)- 

i<K 

Note that the self-feedback (|34| at level Hi implies that 

(37) \/t S{t + l)>S{t). 

For a randomly chosen initial state, S{t) is a random variable. Note that 5(0) is 
a binomial random variable that counts the number of failures (zeros) in K inde- 
pendent trials with success probability 0.5. In contrast, 5(1) is a binomial random 
variable that counts the number of failures in K independent trials with success 
probability 0.25. A straightforward application of the Central Limit Theorem shows 
that 

Pr(5(0) < m/lQ & 5(1) > lli^/16) > q 
for all sufficiently large K. 

This means that for a proportion of > g states we will have s^^^i^^d — 1) = 1 for 
9/16 < i < 11/16, and s;„^(j)(d) = for 9/16 < i < 11/16, or 

Sp{i){d) = l for all i < l/4i^, 
Sp(,) (d -I- 1) = for all i<l /AK. 

By dSll), we get that 

Sp{i) (t) = for i < K/A and t>d+l, 

so (c) and (d) hold. Also, s/j^(j-)(d) = for i < K/2, so Sfi^(^i-^{d + 1) = for 
i<K. By §7^ again, 

Sh,{i){t) — for all i < K and t>d + l, 

which clearly implies (e). □ 

10.4. The proof of Lemma 15.31 Recall the definition of crude vectors from the 
end of Section [8] and let r = \Ri\. The following technical result is identical with 
Lemma [5T3I except that we relabeled the input vectors for convenience as z g 2*^^+'' 
instead of {sxig , sr), with z \ playing the role of sxi^ , and consider the output 
vector simply as an element of 2*^^ instead of specifying Xi-^ as its set of coordinates. 
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Lemma 10.5. Fix k. For every positive integer I let Z he the set of all vectors 
z g 2'°^+'' that are crude or such that x — z \ 2^^ is coding. Fix a coding vector 
X* € 2'^^. Then there exists an L-function F^ : 2*^^+'' — > 2^^ that satisfies for all 
inputs z G Z: 

• -^3(2) ~ X ^ z \ 2^^ if z is coding; 

• F^{z) — X* if z is crude. 

Proof. Let a = £ + f - 1. For z = (z°, . . . , z") define 

ONE{x) = V(A(z°), . . . , A(z")), ZERO{x) = A(V(z°), . . . , V(z")). 

Observe that ONE{z) = 1 implies that z is crude or z ^ Z and ZERO{z) = also 
implies that z is crude ox z ^ Z. 

For simplicity of notation, identify x* with the set of coordinates where this 
vector takes the value 1. Define the output of coordinatewise for i < fc£ by 

{Fz{z)), ^z^\l ONE{x) for i e x* 
{F^{x)\^ z,AZERO{x) for i ^ x* . 

Now, if z e Z is not crude, then x — z \ 2^^ is coding and so Xi V ONE{x) = Xi, 
Xi A ZERO{x) — Xi, and Fz[z) = x. On the other hand, because of the choice of 
clauses in (p8| . F^{z) = x* ii z is crude. 

Building a cooperative Boolean circuit of suitable depth and size that depend 
on t and hence on n with (1 + e) log(n) — M that implements the calculations of 
ONE{z), ZERO{z), and ([55)1 is straightforward using the technique of the proof 
of Lemma 15.11 □ 

11. Conclusion and future directions 

We have constructed examples of cooperative Boolean systems with synchronous 
updating in which most initial conditions belong to the basin of attraction of a single 
attractor that can be of length > c^ for any c < 2 and sufficiently large N. This 
contrasts sharply with results on various other types of dynamical systems that 
show nongenericity or absence of non-steady state attractors under the assumption 
of cooperativity. These systems are also bi-quadratic. It is shown in [7] that 
upper bounds on the proportion of monic regulatory functions imply nontrivial 
upper bounds on c for bi-quadratic cooperative Boolean systems with an attractor 
of length > c^ ; in particular, if this proportion is zero, then c < 10^/''. In the 
follow-up paper [9] we will re-examine this upper bound in the context of p-c-chaos. 

Exponentially long attractors in Boolean systems are a hallmark of chaotic dy- 
namics. Two other important hallmarks of chaos are a small fraction of eventually 
frozen nodes and high sensitivity to initial conditions. Sensitivity to initial condi- 
tions can be formalized in a variety of ways. For example, let us call a Boolean 
network p-unstable if a random single-bit flip in a randomly chosen initial condition 
moves the system to the basin of attraction of a different attractor with probabil- 
ity > p. The systems that we constructed in this paper are extremely chaotic 
with respect to attractor length and the expected proportion of eventually frozen 
nodes, but also p-coalescent, which contradicts 1 — p-instability. In the follow-up 
paper [9] we will construct, for any given 0<p<l<c<2, examples of Boolean 
systems that are simultaneously p-c-chaotic and p-unstable. However, Theorem 5 
of [7] shows that for a/S < c and p > 0.75-1- ^Yn^TS ^'^ cooperative Boolean system 
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that uses only binary AND and binary OR as regulatory functions can be simulta- 
neously p-unstable and have an attractor of length > 0.75. We will improve upon 
this result in the context of p-c-chaos and also explore the relation to other notions 
of sensitive dependence on initial conditions in [9j . 
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